DI Results
Load and stress tests were performed for Data Intake v12.2 in a load-balanced environment with a 4-JVM cluster.
The enrollment processing flow included the following actions: beginLoading, addRecord, complete, and endProcess.
Results:
-
50,000 records were processed in 13 minutes.
-
100,000 records were processed in 42 minutes.
For reference, the observed throughput was approximately:
-
64 records/sec for the 50,000-record run.
-
40 records/sec for the 100,000-record run.
Specs
|
Environment |
|
|---|---|
|
DI Properties |
4 cycle instance running with DI |
|
|
dataIntake.period=10 |
|
|
dataIntake.reProcessingLimit = 10 |
|
|
dataIntake.yieldTimePeriod = 1000 |
|
|
dataIntake.recordGroupSize = 50 |
|
|
dataIntake.gridCapacity = 5000 |
|
|
dataIntake.addRecordCorePoolSize = 150 |
|
|
dataIntake.corePoolSize=150 |
|
Memory |
6 GB heap |
DB connection pool size
|
# |
Data Source Name |
Parameters |
|---|---|---|
|
1 |
ADMINSERVERDS ADMINSERVERSEARCHDS ADMINSERVERRESOURCEDS ADMINSERVERREADONLYDS |
maxActive = 300 maxIdle = 50 minIdle = 10 initialSize = 20 maxWait = 10000 |
Results
| DI Results for Enrollment on 12.2 | |
|---|---|
|
Record count |
Total Time |
| 50,000 | +00 00:13:28.122000 |
| 100,000 | +00 00:42:07.068000 |
Note: Above mentioned Properties are suggested purely based on Transaction configuration, List of SQLs involved and hardware specifications. And it can vary depending on configuration/Dump size and hardware specifications.
DB CPU Utilization
Application CPU Utilization
DB Memory Utilization
Application Memory Utilization